Multi-K Machine Learning Ensembles

نویسندگان

  • Matthew Whitehead
  • Larry S. Yaeger
چکیده

Ensemble machine learning models often surpass single models in classification accuracy at the expense of higher computational requirements during training and execution. In this paper we present a novel ensemble algorithm called Multi-K which uses unsupervised clustering as a form of dataset preprocessing to create component models that lead to effective and efficient ensembles. We also present a modification of Multi-K that we call Multi-KX that incorporates a metalearner to help with ensemble classifications. We compare our algorithms to several existing algorithms in terms of classification accuracy and computational speed.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Ensemble Learning and Pruning in Multi-Objective Genetic Programming for Classification with Unbalanced Data

Machine learning algorithms can suffer a performance bias when data sets are unbalanced. This paper develops a multi-objective genetic programming approach to evolving accurate and diverse ensembles of non-dominated solutions where members vote on class membership. We explore why the ensembles can also be vulnerable to the learning bias using a range of unbalanced data sets. Based on the notion...

متن کامل

Studies with a Generalized Neuron Based PSS on a Multi-Machine Power System

An artificial neural network can be used as an intelligent controller to control non-linear, dynamic system through learning. It can easily accommodate non-linearities and time dependencies. Most common multi-layer feed-forward neural networks have the drawbacks of large number of neurons and hidden layers required to deal with complex problems and require large training time. To overcome these...

متن کامل

Ensemble Learning for Multi-Source Neural Machine Translation

In this paper we describe and evaluate methods to perform ensemble prediction in neural machine translation (NMT). We compare two methods of ensemble set induction: sampling parameter initializations for an NMT system, which is a relatively established method in NMT (Sutskever et al., 2014), and NMT systems translating from different source languages into the same target language, i.e., multi-s...

متن کامل

Impulse Noise Detection in OFDM Communication System Using Machine Learning Ensemble Algorithms

An impulse noise detection scheme employing machine learning (ML) algorithm in Orthogonal Frequency Division Multiplexing (OFDM) is investigated. Four powerful ML's multi-classifiers (ensemble) algorithms (Boosting (Bos), Bagging (Bag), Stacking (Stack) and Random Forest (RF)) were used at the receiver side of the OFDM system to detect if the received noisy signal contained impulse noise or not...

متن کامل

Multi-target regression with rule ensembles

Methods for learning decision rules are being successfully applied to many problem domains, in particular when understanding and interpretation of the learned model is necessary. In many real life problems, we would like to predict multiple related (nominal or numeric) target attributes simultaneously. While several methods for learning rules that predict multiple targets at once exist, they ar...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012